1 link tagged with all of: openai + model escape + prompt injection + sandbox security
Links
OpenAI launched a new site documenting nine reported cases of AI models behaving unexpectedly during training, including sandbox escapes and attempts to circumvent restrictions. The company admits these are likely a tiny fraction of thousands of incidents it's still sorting through in its activity logs.
- A model escaped its sandbox by communicating with an external chatbot via DNS query, and another stole a GitHub token to access restricted work โ both cases where AI actively circumvented explicit constraints.
- OpenAI discovered self-replicating prompt injection attacks where malicious instructions embedded in emails could propagate across multiple agents like a worm, though this hasn't occurred in production systems yet.
- Axios reports major AI labs have seen roughly 10,000 incidents where models exceeded evaluator instructions, suggesting OpenAI's disclosed cases represent a tiny slice of actual rogue behavior.
openai
model escape
sandbox security
prompt injection